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BACKGROUND OF THE rNVENTIQN 



15 a) Field of the Invention 

The invention is directed to a method and an arrangement in 
microscopy, particularly fluorescence laser scanning microscopy, for examination of 
predominantly biological specimens, preparations and associated components. This 
includes methods for screening active ingredients based on fluorescence detection 

20 (high throughput screening) and methods of laser scanning microscopy based upon 

other contrast mechanisms. 



b) Description of the Related Art 

A typical area of application of light microscopy I'or examining 
25 biological preparations is fluorescence microscopy (Pawley, "Handbook of 

Biological Confocal Microscopy"; Plenum Press 1995). In this case, determined 

dyes are used for specific labeling of cell parts. 

The irradiated photons having a determined energy excite tlie dye 

molecules from the ground state to an excited state by the absorption of a photon. 
30 This excitation is usually referred to as single-photon absorption (Fig. la). The dye 

molecules excited in this way can return to the ground state in various ways. In 

fluorescence microscopy, the most important is the transition with emission of a 
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nuorescence photon. Because of (he Stokes shift, there is generally a red shift in the 
wavelength of the emitted photon in comparison to the excitation radiation; that is, it 
has a greater wavelength. Stokes shift makes it possible to separate the lluorescence 
radiation (rom the excitation radiation. 

The lluorescent light is split off from the excitation radiation by 
suitable dichroic beam splitters in combination with blocking filters and is observed 
separately. This makes it possible to show individual cell parts that are dyed with 
different dyes, hi principle, however, several parts of a preparation can also be dyed 
simultaneously with different dyes which bind in a specific manner (multiple 
fluorescence). Special dichroic beam splitters are used again to distinguish between 
the fluorescence signals emitted by the individual dyes. 

In addition to excitation of dye molecules with a high-energy photon 
(single-photon absorption), excitation with a plurality of low-energy photons is also 
possible (Fig. lb). The sum of energies of the single photons corresponds 
approximately to that of the high-energy photon. This type of excitation of dyes is 
known as multiphoton absorption (Corle, Kino, "Confocal Scanning, Optical 
Microscopy and Related Imaging Systems", Academic Press 1996). Fig. lb shows 
excitation by means of simultaneous absoi-ption of two photons in the near infrared 
wavelength region. However, the dye emission is not influenced by this type of 
excitation, i.e., the emission spectrum undergoes a negative Stokes shift in 
multiphoton absorption; that is, it has a smaller wavelength compared to the 
excitation radiation. The separation of the excitation radiation from the emission 
radiation is carried out in the same way as in single-photon excitation. 

The prior art will be explained more fully in the following by way of 
example with reference to a confocal laser scanning microscope (LSM) (Fig. 2). 

An LSM is essentially composed of four modules: light source L, 
scan module S, detection unit DE and microscope M. These modules are described 
more fully in the following. In addition, reference is had to DE19702753A1 and 
US6167173. 

Lasers with different wavelengths are used in an LSM for specific 
excitation of di fferent dyes in a preparation. The choice of the excitation 
wavelength is governed by the absorption characteristics of the dyes to be examined. 
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The excitation radiation is generated in the Ught source module L. Various lasers 
A-D (argon, argon/krypton, Ti:Sa hisers) are used for this purpose. Further, the 
selection of wavelengths and the adjustment of llie intensity of the required 
excilalion wavelength is carried out in the light source module L, e.g., using an 
5 acousto-optic modulator. The laser radiation subsequently readies the scan module 

S via a fiber or a suitable mirror arrangement. The laser radiation generated in the 
light source L is focused in the preparation (specimen 3) in a diffraction-limited 
manner by the objective (2) via the scanner, scan lens and tube leus. The focus is 
moved over the specimen 3 tvvo-diraensionally in x-y direction. The pixel dwell 
10 times when scamiing over the specimen 3 are mostly in the range of less than one 

microsecond to several seconds. 

In confocal detection (descanned detection) of fluorescent light, the 
light emitted from the focal plane (specimen 3) and from the planes located above 
and below the latter reaches a dicliroic beam splitter (MDB) via the scanner. This 
15 dichroic bearn splitter separates the fluorescent light from the excitation light. The 

fluorescent light is subsequently focused, via dichroic beam splitters DBS 1-3 and 
pinhole optics, on a diaphragm (confocal diaphragm/pinhole) (PHI , 2, 3, 4) located 
precisely in a plane conjugate to the focal plane of the objective 2. In this way, 
fluorescent light components outside of the focus are suppressed. The optical 
20 resolution of the microscope can be adjusted by varying the size of the diaphragm. 

Another dichroic blocking filter (EFl-4) which again suppresses the excitation 
radiation is located behind the diaphragm. After passing the blocking filter, the 
fluorescent light is measured by means of a point detector (PMTl-4). 

When using multiphoton absorption, the excitation of the dye 
25 fluorescence is carried out in a small volume in v/hich the excitation intensity is 

particularly high. This area is only negligibly larger than the detected area when 
using a confocal arrangement. Accordingly, a confocal diaphragm can be dispensed 
with and detection can be carried out directly after the objective, with reference to 
the detection direction, or on the side remote of the objective (non-descanned 
30 detection) via T-PMT, PMT 5. 

In anotlier arrangement (not shown) for detecting a dye fluorescence 
excited by multiphoton absoiption, descanned detection is caixied out again, but this 
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time the pupil of the objective is imaged by the pinhole optics PH in the detection 
unit (non-confocal descanned detection). 

From a thrce-dimensionally illuminated image, only the plane 
(optical section or slice) coinciding with the focal plane of the objective is 
reproduced by the above-described detection arrangements in connection with 
corresponding single-photon absorption or multiphoton absorption. By recording a 
plurality of optical slices in the x-y plane at different depths z of the specimen, a 
three-dimensional image oftiie specimen can be generated subsequently iii 
computer-assisted manner. 

Accordingly, the LSM is suitable for examination of thick 
preparations. The excitation wavelengths are determined by the utilized dye with its 
specific absorption characteristics. Dichroic filters adapted to the emission 
characteristics of the dye ensure that only the fluorescent light emitted by the 
respective dye will be measured by the point detector. 

According to the prior art, line scanners, as they are called, are also 
used instead of point scaimers (Corle, Kino, "Confocal Scanning Optical 
Microscopy and Related Imaging Systems", Academic Press 1996). The basic 
construction essentially corresponds to that of an LSM according to Fig. 2. 
However, instead of a pouit focus, a line is imaged in the specimen (3) and the 
specimen to be examined is scanned in only one direction (x or y). The line focus is 
generated by means of at least one cylindrical lens ZL (shown in dashes in Fig. 2) in 
the colUmated illumination beam path, a pupil plane of the microscope arrangement 
being located in the focal length of the latter. In a construction of this kind, a slit 
diaphragm instead of a pinhole diaphragm PH 1-4 is used as confocal diaphragm 
(PH). Non-descanned detection can also be cairied out with this arrangement when 
using multiphoton absoiption. In this connection, the confocal diaphragm (PH) can 
be omitted again. A CCD camera (non-descanncd) or line (descanned) with 1024 or 
more image points can be used for detection instead of the point detector (PMT). 
The image acquisition rate can be substantially increased by scanning a line instead 
of a point. Therefore, this scanning method can be used for observing high-speed 
processes in real time (real time microscopy). 
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It is disadvantageous in tiiis method that the depth resolution through 
the sUt diaphragm is reduced by a factor of 1 .4 compared with point-scanning laser 
scanning nncroscopes. This is due to llie fact that the contbcal slit diaphragm 
suppresses only fluorescent light components outside of the con focal section at right 
5 angles to die scan line. Lateral resolution is also worse. 

In another arrangement for real time microscopy according to the 
prior art, the entire field to l'>e examined is illuminated by an e.xpanded light source. 
However, only special point patterns of the total field to be scanned are uncovered 
by a rapidly rotating disk. These methods are mostly known in technical literature 
10 as Nipkow disk methods (Code, Kino, "Confocal Scanning, Optical Microscopy and 

Related Imaging Systems", Academic Press 1996). 

In another method according to the prior art, known as structured 
illumination (see Fig. 3), the modulation depth of the optical imaging of an 
amplitude structure (e.g., grating) is used as a criterion for depth of field. The image 
15 of the periodic structure is distinguished by the frequency of the modulation and the 

phase position (image phase) of the modulation. 

Various projection scenarios can be obtained by means of a phase 
shift of the structure at right angles to the optical axis. 

Generally, at least tlrree phase images PB are required at 0°, 120° and 
20 240° in order to calculate depth-discriminated optical sections without stripes. 

These phase images (PB) are subsequently calculated to form a (confocal) optical 
section image in an image processor by the following formula: 



hcciion (^) = Const . ^/(/(A-,0°) - l{xMO°)f + {!(x,nQ°) - /(x,240°))- + {[{x,Q°) - I{x,2A0°))\ 

25 

where I(x, angle) describes the intensity at the respective pixel in the corresponding 
phase image. 

It is simplest to cany our the recording of three or more phase images 
sequentially. In this connection, it is assumed that the specimen is not moved during 
30 the measurement of the images. The section images or section stacks which are 

calculated from the phase images in this way can be displayed subsequently on a 
standard PC and monitor by means of 3-D evaluating software. The spatial 
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resolution along the optical axis depends on the wavelength of the light, the numeric 
aperture of the objective and the modulation frequency. For a detailed description of 
the calculation algorithm, reference is had to T. Wilson, et al. , "Method of obtaining 
sectioning by using structured light in a conventional microscope". Optics Letters 22 
(24), 1997. 

A further disadvantage in previous methods for real time microscopy 
consists in that multiple detection devices must be provided when a plurality of dyes 
are examined simultaneously. This heightens the requirements for data transfer and 
increases the cost of a device of this kind. Therefore, at present, only microscopes 
are used for sequential image display of different dye fluorescences. DE 19829981 
Al describes a method for changing the excitation wavelengths and/or the intensity 
during the scanning process. 

OB.1ECT AND SUMMARY OF THE INVENTION 

It is the primary object of the invention to provide a novel method by 
which the preparations can be imaged in real time and with high optical resolution. 

This object is met by a method for depth-resolved optical detection of 
a specimen comprises the steps of providing a scanning movement over the 
specimen or at least a part of the specimen of an illumination light distribution of at 
least one wavelength which is generated on or in the specimen, providing detection 
particularly of the light which is influenced based on interaction with the specimen, 
especially fluorescent light and/or reflected light and/or luminescent light and/or 
scattered and/or transmitted light, the illumination light having a modulation in at 
least one spatial direction, and carrying out the scanning movement and detection 
associated with the scanning with the scanning movement at least in a flrst and a 
second different phase position of the modulation and/or first and second frequency 
of the periodicity of the modulation and calculating at least one optical section 
image through the specimen or through part of the specimen. 

Further in accordance with the invention, an arrangement for depth- 
resolved optical detection of a specimen, especially of the light of an illumination 
light distribution which is influenced based on interaction with the specimen, 
especially fluorescent light and/or reflected light and/or luminescent light and/or 
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scattered and/or transmitted light comprising means for illuminating the specimen 
with at least one wavelength, means for generating a relative movement between the 
specunen and illumination tight, means for imaging the light influenced by the 
specimen on at least one detector, means for imaging a structure which changes in a 
spatially periodic manner in at least one dimension in diflerent phrases and/or 
frequencies of the periodicity on the specimen and means for calculating at least one 
optical section image from the local infomiation of the light influenced by the 
specimen. 

The invention is particularly suited for use in applications requiring 
multiple fluorescences, since these can be recorded simultaneously and 
advantageously also with optical resolution comparable to a point-scanning LSM, 
but in real time. 

The method can be used in image-displaying microscope systems 
such as laser scanning microscopes for three-dimensional examination of biological 
preparations with an optical, spatial resolution of up to 200 nm and in analytic 
microscope systems such as fluorescence correlation spectrometers. 

Further, fluorescence detection-based methods for screening dyes 
such as in chip readers are included. These methods differ from the methods of laser 
scanning microscopy primarily in that the image field is appreciably larger. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 

Fig. 1 A illustrates in schematic form single photon absorjDtion; 
Fig. I B illustrates multiphoton absorption in schematic form; 
Fig. 2 illustrates a confocal laser scanning microscope (LSM); 
Fig. 3 illustrates stioictured illumination, a known method, in block 

diagram form; 

Fig. 4 shows a possible method flow chart; 

Fig. 5 schematically shows specimens dyed by different dyes in the 
scanning field which require different wavelengths to excite fluorescence; 



Fig. 6 illustrates sciiematically that with respect to Fig. 5, the coding 
frequency and/or the coding phrases of the excitation scan line transfer(s) to the 
detected nuoresccncc in the reoperative region; 

Figs. 7A-D schematically show phase coding realized in a possible 

5 anangement; 

Fig. 8 shows schematically a line focus in a scan field in which phase 
positions of the amplitude modulations are presented; 

Figs. 9A-C show a first arrangement of a stmctured illumination with 

single scan line; 

10 Figs. lOA, B show schematically a structured illumination with single 

scan line and coding of the modulation phrase or modulation frequency; 

Fig. \ 1 illustrates schematically another arrangement where the optics 
is shown in the XZ plane; 

Fig. 12 illustrates schematically the detection diagram of a CCD 
1 5 surface of the multispectral line scanner in the XZ plane; 

Fig. 13 schematically shows the constmction of the electronics for 
detecting the signals with a line detector; 

Fig. 14 shows schematically the detection of the stripe images quasi- 
simultaneously when using three lines; 
20 Fig. 15 schematically shows the optical construction of the Fig. 14 

application in the XZ plane; 

Fig. 16A shows a special grating structure for the quasi-simultaneous 
recording case; 

Fig. 16B shows a second aiTangement for generating a double line 

25 focus; 

Fig. 17 is directed to a structural illumination with quasi- 
simultaneous multispectral excitation where a plurality of parallel excitation lines of 
different wavelengths are generated by dispersive element; 

Fig. 18 schematically shows the combination of a multispectral line 
30 scanner with structured illumination; 
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Fig. 19 schematically shows a structure used in an intennediale image 
plane which is arranged after the scanners in the direction of the specimen in a 
punctiForm specimen interaction; 

F'ig. 20A schematically shows two plane wavefronts in the XY plane 
for examination of macroscopic specimens; 

Fig. 20B shows the corresponding signal resulting along the scan hue 
for a quadratic specimen interaction (two photon excitation); 

Fig. 21 graphically shows the specimen ion interaction using a 
structured scan line in comparison to a homogeneous scan line, the iuterocties_being 
identical m both lines; 

Figs. 22 A-D schematically show different constructions for 
generating two partial beams; and 

Figs. 23 A and B schematically show laser scanning microscopes 
with an angements for the interference of partial light beams which contain a light 
module. 

BRIEF DESCRTPTTON OF THR TNVENTION AND THE PRE FERRED 
EMBODIMENTS 

The object of the method for increasing spatial detection resolution, 
preferably in a method displaying images in real time, is a line-shaped excitation and 
detection of the excitation radiation and/or excited fluorescence reflected, scattered 
and/or transmitted by a specimen. For this purpose, a line focus of the excitation 
radiation is generated in the specimen by means of suitable optics which are 
described more fully in the following. Fig. 4 shows a possible measurement flow 
chart. A scan field with the line focus is shown on the left-hand side. The line focus 
can be displaced along the arrow by suitable auxiliary means (scanner mirror in one 
direction). The increase in axial and lateral resolution is carried out by means of a 
structuring of the line focus. The structuring is carried out by superposing the scan 
line with a periodic structure which is generated, for example, by a sine grating ni 
the beam path. With coherent illumination, a structure can also be generated in the 
specimen by means of the interference of two coherent partial beams (Wilson, 
W098/45745). At least two images with different phase positions of the periodic 
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structure are recorded. In principle, the optical section can also be carried out by 
recording images with different modulation frequencies of the structure. 

The illumination of the specimen can be carried out with spatially and 
temporally coherent or incoherent illumination. For example, a spatially coherent 
laser light source can also be used by employing a diffusion screen or by arraying a 
plurality of individual foci in the specimen for an incoherent illumination. 

At least two phase images PB with image phases of, e.g., 0° and 180° 
are advantageously required when using an excitation wavelength for calculating an 
optical section image in the image processor. With n excitation wavelengths, n+1 
phase images are necessary. For one excitation wavelength, the signal emitted by 
the specimen has the following fonn along a scan line: 
Isi^ (x) = Cix) ■ cos{k ■ x) + B(x), 

where C(x) contains the actual object information (e.g., the concentration and 
effective cross section of the dye or the local reflection coefficient) at position x 
inside the confocal optical section and along the line focus for the excitation 
wavelength and represents the sought for quantity. B(x) contains the object 
infomiation outside of the confocal area. B(x) is not modulated, since the structure 
is not focused shar}:>ly outside the confocal area. The inverse modulation frequency 
of the structured excitation is represented by k. The above equation has two 
unknowns C(x) and B(x). To determine C(x), it is necessary to take two phase 
images. Let the phase images be designated by I|(x), i=0,l ,. . .n and characterized by 
a relative phase displacement of the modulation of i-^p (image phases), where the 
following equation system results: 

(x) = dx) ■ cos(/c ■ x) + B{x) 
/, (ji) = C{x) ■ cos{k ■ x + ^(p) + B{x) 

The sought for object information is given by solving the equation system for C as 
follows: 

C{x) = ^ ^^-^ . 

cos(/( • X ■ /S,(p) - cos(/c • x) 

To determine C(x), two images with different modulation frequencies 

kfl and k, can also be taken in an analogous manner. Let tl\e frequency ifnages be 
designated by Ii(x), i=0,l,. . .n, so that the following equation system results: 
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f,(x) = Cix)-cos{k,-x) + B(x) 
/,(.v) = C(r) cos(/(, ■x) + B(x). 

The sought for object information is given by solving the equation system for C as 
follows: 

ex.) = -^- . 
cos(/[;, ■ x) - cos(/c„ ■ .v) 

C(x) can also be obtained by taking at least two images with different 

phases and frequencies of modulation. 

An optical section in at least one specimen plane is composed of this 

line-related object infonnation and can be further processed according to the prior art 

to obtain at least one image of at least one image stack. 

AVhen only one excitation wavelength is used and at least three phase 

images (e.g., with relative phase posidons of 0°, 120° and 240°) are recorded, the 

algorithm for obtaining the object infonnation explained according to the prior art 

(T. Wilson, et al., "Method of obtaining sectioning by using structured light in a 

conventional microscope", Optics Letters 22 (24), 1997) can also be applied in all of 

the arrangements described herein. 

When a plurality of wavelengths are excited simultaneously, the 

subsequent separation of the signals of the specimen is carried out by a special phase 

coding or frequency coding of the modulation stnicture for the different excitation 

wavelengths. In general, the quantity of phase images required for n simultaneous 

excitation wavelengths is n+I . In this connection, different excitation wavelengths 

are separated from one another by a defined wavelength-specific position 

displacement of the modulation (coding phase) and/or a characteristic modulation 

frequency (coding frequency). The light emitted by the specimen (e.g., 

lluorescence) which occurs through an interaction of the excitation light of the 

respective wavelength with the specimen then possesses the specific coding phase 

and/or coding frequency depending on the excitation wavelength and can 

accordingly be separated according to the algorithm which will be given in the 

following. 
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Accordingly, when a specimen such as that sliown in Fig. 5 is dyed 
by different dyes (1, 2, 3) in the scanning field which require different wavelengths 

(L,, L,, L3) to excite lluorescence, the coding frequenoy (f,, t;, i\) and/or the coding 
phases ((}),, (]),, (j)^) of the excitation scan line transrcr(s) to the detected fluorescence 
in the respective region (1 ,. . .n), see Figure 6. 

Preferably, all excitation wavelengths have the same coding 
Irequeiicy, i.e., one modulation frequency, but ditlerent coding phases. The 
following discussion is restricted to this case with phase coding, wherein a coding by 
means of modulation frequency is to be treated analogously and is the subject of the 
invention. 

For two excitation wavelengths, the signal emitted by the specimen 
has the following form along a scan line: 

I^.^ (x) = C, (x) • cos(A- ■x + (/>,) + (a) + C, (a) • cos(/c ■x + <p.,)+B, (x), 
where C,(x) or C^ix) represents the sought for object information (e.g., the 
concentration and effective cross section of the dye) at position x inside the confocal 
optical section and along the line focus for the two excitation wavelengths. Bi(x) or 
Bj(x) contains the object information outside of the confocal area. B,(x) and B^Cx) 
are not modnlated, since the structure is not focused sharply outside the confocal 
area, (j), and ^^^^ coding phases assigned to the respective excitation 

wavelengths, and k is the inverse modulation frequency (which is identical for both 
excitation wavelengths in this example) of the stnictured excitation. The above 
equation has four unknowns C,(x), B,(x), C2(x) and B2(x). 

To determine C|(x) and C,(x), it is necessaiy to take three phase 
images. Let the phase images be designated by Ii(x), i=0,I,. . .n and characterized by 
a relative phase displacement of the modulation of i^Acp (image phases), where the 
following equation system results: 

(x) = C, (x) ■ cos(/c • -v + v^, ) + (x) + C, ( A-) ■ cos(/v • x + </>,)+ (x), 
(.y) = C, (a-) • cos(A' • A- + ^6, + ^(p) + /?, (a) + C, (a) • cos(A- ■ a + (j)^ ^^(p) + B^(x), 
/, (a) = C, (a) ■ cos(A' ■x + (^,+2-A(p) + 7i, (a) + C. (a) ■ cos(^ ■ a i- (f), + 2 ■ A(p) + B, (a). 

The sought for object information is given by solving the equation 
system for C, and as follows: 
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C, (x) = f-c, , (x) • ( /, (.V) - (X)) + c,, ix) ■ (/, (a) - /„ (x))] / det(.v) 

C, (x) = [c, , (x) ■ (I, ix) - J,ix)) + r,, (x) • ( /, (x) - I, (x))] / det(x), 

where c,. (x) = cos(^r ■ x + (p^ + i ■ Acp) - cos(k ■ x + ^, ) 

and det(x) = c,, (x) • a,, (x) - c„ (x) c„ (x) . 
5 Thus, in order to obtain the object infonnation, the coding phases 

and the inverse modulation frequency (k) for the individual excitation wavelengtiis 

rnusl be known. In order to solve the equation system and accordingly to separate 

the object information which was made visible by the respective excitation 

wavelength, three phase images are required in the case of two-dye excitation, 
10 wherein the image phase displacement (A<p) between the individual images is 120° 

in the simplest case. 

The object information from outside the confocal area can only be 

obtained for the sum of the amounts of all exciting wavelengths. In the present 

example, this background is; 
1 5 (x) + i?2 (x) = (x) - C, (x) • cos{k ■x + <p,)-C^ (x) • cos(A' • x + ^, ) 

which can be calculated when C, and are known. 

Expansion to three excitation wavelengths is given in equivalent 

manner fi-om the solution of the con'esponding equation system, where CjCx) or 

B-,(x) represents the object information excited by the third wavelength from inside 
20 or outside the confocal section. The object infonnation for the individual 

wavelengths is given as follows: 

C, =Ic,j -c,, ■C2j (/3 -/o) + (c,3 -Cj^ -6',, •C33) (/3 -/o) + (cj2 ■ c - c,, •c_,,) (/, -/„)]/det 
=[(c,3 -c,, -c„ ■c„)\I, -/„) + (c„ -c,, -f,, •C3,) (/, -/j4-(c„ -c,, -c„ c,,) (/, -/„)]/dct 

25 with (j)3(x) as coding phase of the modulation in the third excitation wavelength and 

det(x) = c,, • (C22 • c„ - c,j • 0,2) + c„ ■ (C23 • C3, - ■ c,3) + • (C21 ■ C32 - ■ C3, ). 

With a three-dye excitation, four piiase images are necessary for 
separating the object information, excited by the individual wavelengths. The image 
phase step size can be 90 degrees, for example. Since the values c,j are constant for 

30 an arrangement with predetermined coding phases and coding frequencies, obtaining 

the object information by signal processing is a simple opeialion. This operation can 
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be indicated by the transfonnation of the scaled image signals Alj(x)=li (x)-lo(x) by 
means of factors \\{x) which are stored as constants and which are given by Cjj(x). 
For three wavelengths, the equations above give, e.g., 
C, S'AJj + J, S'Al, +fj S'Al, 
C, fTzl/, +,/; iAl\ +/„ iAI, 

Cj =f, S'Ai, I /; 17; ^Al, 

By way of generalization, it is necessary for simultaneous excitation 
with n wavelengths to take n+l images Tq to !„, each with its own phase and/or 
frequency of excitation modulation. Phase images (image phase: cpj) with phase 
coding of the excitation wavelength ((|)j) give the following images which contain the 

image information of the pseudo-con focal section (Cj) and of background (Bj), 
which image information is excited by the respective jth wavelength: 

^0 (^) ~ X ■ '^osC^ -x + ^j + Bj {x) 
/, {x) = Y^Cjix) ■ cos(/t ■ X + + r/J, ) + (x) 
(x) = ^ C ■ {x) ■ cos(/c • X + (i>j -^(Pt)^ Bj (x) 

K (^) - X ('^^ ■ ^^^i^ ■ ^ + 'Pj + <P» ) + (^) 

The resulting equation system having the following fonn 

c,2 1 f^'l f ^' ~-^'>^ 

where Cjj(x) cos(k H x i- cpj) cos(k If x + 

can be solved for the sought for image information from inside tiie pseudo-confocal 
section separately according to the mdividual excitation wavelengths by known 
mathematical methods (e.g., Cramer's rule). 

Further, the image information from outside the pseudo-confocal 
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section that is excited by all wavelengths can accordingly be determined according 
to the following equation: 

J Bj (a-) = /o (x) - 1; (x) ■ cos(/< • .V + + (p, ) . 

Analogous relationships apply when the frequency is used, instead of 
5 or in addition to the phase, for coding the various wavelengths and/or images. The 

coefficients Cjj are suitable for modification. 

The coefficients Cy can be determined by the measurement methods 
described in the following, regardless of whether phase and/or modulation Irequency 
are/is used for image coding and wavelength coding, respectively. The coding 
10 frequency and the coding phase are determined (e.g., by means of a test object such 

as a glass plate or a mirror) for a reference wavelength (for example, 488 nm) for 
purposes of calibration. For this purpose, the periodic structure is imaged on the test 
object and measured by the detector, and the coding frequency and coding phase are 
measured and accordingly determined for a fixed image phase at the location of the 
1 5 specimen. The coding phases and coding frequencies of the other wavelengths can 

now be measured relaUve to this reference for a fixed image phase. In a possible 
anangement, the phase coding is realized by dispersion (parallel offset) in a plane- 
parallel plate P which simultaneously serves as a support for an amplitude grating 
(structure S) an anged in ftont of it in the illumination direction (see Fig. 7 A). A 
20 slight, wavelength-dependent parallel offset in the plane vertical to the axis of 

rotation and to the optical axis results when polychromatic excitation light passes 
tliiough the plane-parallel plate P which is inclined sUghtly about axis A 
(inclination: y; thickness: d): 

AxiA.) = d ■ (sin ^ - cos^ • tan >9(1)), where p{X) = sin"' ((sin ;')/ n(A)). 

25 When the plate is located in an intermediate image plane (see Fig. 

9A) of the microscope arrangement, this offset is expressed as the phase shift 
between the amplitude modulations of tlie individual excitation line foci. Fig. 8 
shows schematically a line focus in a scan field, in which the phase positions of the 
amplitude modulations for, e.g., three different excitation wavelengths are shown on 

30 the right-hand side of the diagram. The x-axis of the diagram corresponds to the 

coordinate along the line focus. Only a section of the scan line is shown on the 
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right-hand side of Fig. 8 to ilkislrate the coding phases. 

A phase displacement of 5 degrees is sufficient for reUably separating 
the signals excited by the corresponding wavelength. Table 1 shows the coding 
phases for a concrete example- 
Table 1 : Phase displacement for important laser lines by dispersion in a BK? plate 
having a thickness of 10 mm with an amplitude grating of 50 lines/mm. The plate is 
inclmed by 5 degrees relative to the normal; lor the reference wavelength of 488 nm, 
this gives a parallel offset of approximately 300 pm relative to the optical axis. 



Wavelength 
(nm) 


Relative 
offset (f-im) 


Phase displacement 

for 50 lines/mm (degrees) 


458 


1.08 


19.5 


476 


0.36 


6.5 


488 


0 


0 


514 


-0.56 


-10.1 


532 


-0.82 


-14.8 


543 


-0.95 


-17T 


633 


-1.47 


-26.5 


1064 


-2.75 


-49.5 



An arrangement for wavelength-dependent phase displacement 
(phase coding) uses an optical grating which is inserted in a pupil plane of the 
microscope airangement, for example, in the scanner. 

Advantageous arrangements for fluorescence and DIG image display, 
for example, are described in the following without restrictions with regard to 
transferability to other optical contrast methods. 

Arrangement 1 : Structured illumination with single scan line 

A fust arrangement is shown in Fig. 9, The pupil beam path of the 
microscope arrangement is shown in dashes. The object beam path is indicated by 
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solid lines, in Fig. 9A (xy-plane), light from the light source (LQ) is shaped into a 
line focus in an intermediate image plane (ZB), for example, by a cylindrical lens 
(ZL), the pupil plane of the microscope arrangement being located in the focal 
length of the cylindrical lens (ZL). An element (ST) which produces an amplitude 
modulation along the scan line is located in an intermediate unage plane in iVont of 
or behind the cylindrical lens (illustrated in iVont of the cylindrical lens). This 
element ST is a transmission grating, for example. As is shown by way of example 
in Figs. 7B/7D, the change m periodicity runs in the X-direction at right angles to 
direction (Y) of the grating lines which are shown schematically as black bars. A 
displacement in this X-dircction, tor example, with the positioning unit PE as is 
shown in Fig. 9, enables a change in the phase position. A dispUiceinent of the 
structure according to Fig. 7D in the Y-direction (displacement not shown) results in 
a variation of the frequency of the amplitude modulation for adapting the optical 
section thickness (see the following) or for changing the modulation frequency 
during the recording of the individual images for calculating the optical section 
image. Tilting around a center of rotation located in the optical axis and an axis of 
rotation in the Y-direction likewise generates this displacement. A rotation of the 
grating about an axis of rotation in the Z-dircction, which coincides with the optical 
axis, for example, likewise generates (see Fig. 16) a phase displacement which has 
different results when imaging a plurality of spatially separate lines on the specimen 
(line running in X-direction). 

The structured scan line is subsequently imaged in the specimen (PR) 
via a main beam splitter (MDB) and a scanner (y), which moves the scan line 
vertical to the line (y-coordinate) and is again located in a pupil of the microscope 
an-angemciit, by means of the scan optics (SO), the tube lens (TL) and the objective 
(O). The relay optics (RL) image the focal point of the cylindrical lens (ZL) on the 
scanner (y). In special arrangements according to the prior art, the relay optics can 
also be dispensed with. For example, they can be omitted when the distance is 
shortened between the two scanners x and y or when the scanners x and y are 
replaced by a gimbal-mounted individual scanner. In principle, the cylindrical lens 
can also be replaced by a cylindrical mirror whose focal point lies on the scanner 
(X). The cylindrical mirror is an anged at 45° in the xz-plane shown in Fig. 9C. In 



18 



1 ir«:!iiM!-.™L'nin!'i-"3 ipjiLn, 



Ihis plane, the minor also has a focusing effect. Further, the beam path is airgled by 
90° to the light source by the miiTor. This is shown schematically in Fig. 9C. 

The emission light collected by the objective (O) is split from the 
excitation light, for example, by means of the main beam splitter (MDB). 
Subsequently, the light from the specimen is focused by means of imaging optics 
(PO) with confocal detection through a slit diaphragm (SB) (slit position in 
longitudinal direction in Z-direction in the drawing), so that fluorescence occurring 
outside of the focus is suppressed. With non-descanned detection, tlie diaphragm 
can be omitted. A line detector or surface detector (DE) (position of line in Z- 
direction) is located behind the slit diaphragm and detects the fluorescence in a 
spatially resolved marmer (along the line focus). In addition, an emission filter (not 
shown) can be provided for suppressing the excitation radiation in the detection 
beam path after the main beam splitter (MDB). The line focus is scanned in one 
spatial direction by the galvo-scamier (y). If the x-scanner is not used for adjusting 
the image phase, it stays in its zero position. 

Fig. 9B shows the same arrangement, but mirrored by 90 degrees 
(YZ-plane). Instead of a line on the specimen, a focus point is shown on the 
specimen in this spatial direction due to the cylindrical lens (ZL) which is not 
effective in this direction. 

In principle, the slit diapliragm can also be omitted. This is useful, 
above all, when the imaging of the fluorescence is not descanned via the scanner but 
is to be carried out directly on a CCD camera or a gated camera for spatially 
resolved measurement of the fluorescence lifetime (LaVision, Picostar), The CCD 
camera sees an intermediate image plane ZB, e.g., in the intermediate image plane 
between the TL and SO of the microscope arrangement. In a microscope according 
to the prior art, it is comiected to a TV port (Fig. 19, TV port position). In addition, 
a CCD camera can be used in the transmission beam path of the microscope 
arrangement (e.g.. Fig. 1 iiistead of T-PMT). The excitation radiation transmitted by 
the spechnen can accordingly be detected with cotrfocal resolution. In addition, 
confocal DlC imaging is also possible. For this purpose, according to the prior art, 
the DlC prism is arranged hi the objective pupil between TL and objective O. 
Further, the image obtained in this way by DIC can be superposed with the images 
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that were generated by signals reilected, scattered and/or emitted by the specimen to 
Form one image. The calcuUition of the conlx^cal section is carried out, for example, 
by taking at least two phase images (see Fig. 4 or the following text). The 
illumination intensity of the lines in the at least two phase images varies periodically 
5 - for example, sinusoidally in x-direction due to the slruclure ST. 'fhe relative 

image phase when using three structured lines is displaced by 1 20-degr6e phases. 
The three phase images are generated in sequence, i.e., three images are scanned 
successively by means of the y-gaWo-scanner (y). The structure (ST) can be a 
transmission grating, for example. The displacement of the image phase can be 
10 can-ied out, for example, with a positioning unit (PE) to which the transmission 

grating is coupled, so that every location of the specimen to be examined can be 
observed with varying brightness. Further, the adjustment of the image phase can be 
earned out as in Fig. 7A with a wavelength by means of a plate (PL) which is 
mounted in rotatable manner, the stmcture being arranged in front of the latter or 
1 5 impressed on it. The plate is to be arranged for this purpose in an intermediate 

image plane of the microscope arrangement as is shown in Fig. 9. The plane-parallel 
plate used for this purpose is located in an intermediate image plane; the structure 
ST (shown in Fig. 7B) is preferably arranged directly on the plate. 

In another anangement, the adjustment of the image phase can also 
20 be carried out by means of another galvo-scamier (X). The scanner (X) adjusts the 

image phase by displacing the scan hne in x-direction. This has the advantage that it 
enables switching between a point-scanning LSM and a line-scanning LSM with 
stnictured illumination by inserting (swiveling in or sliding in) the cylindrical lens 
(ZL) and the transmission grating coupled with a detection-side beam deflection for 
25 switching from a point detector to a line detector (DE). I f the scanner X is not used 

for adjusting the image phase, it stays in its zero position (i.e., is switched off). 

Arrangement 2: Structured iUumination with single scan line and coding of the 
modulation phase or moduhition frequency 

30 

A second aiTangement uses different coding phases depending on the 
excitation wavelength used in the structuring of the scan line. The signals of the 
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fluorescence excited by the individual wavelengths can accordingly be digitally 
separated. Fig. I OA schematically shows a possible construction in the XZ-plane. 
Light ofdifferent wavelengths IVoni the light source (LQ) undergoes amplitude 
modulation by means of a structure (ST). The sti ucture is located in an intennediate 

5 image plane of the microscope arrangement. The structiu-e is arranged so as to be 

displaceable via a positioning unit (PE), so that the structure can be displaced along 
the scan line and different image phases can be adjusted. Subsequently, the 
structured ligiit is shaped in cylindrical optics (ZL) to form a line in the pupil plane 
of the microscope arrangement. For this purpose, the cylindrical lens (ZL) is 

10 arranged at the distance of its focal length from the pupil (scanner X). Further, the 

adjustment of the image phase can be carried out by the scanner (X) which is located 
in a pupil plane of the microscope arrangement. 

Fig. lOB shows a simplified anangement with only one scanner (Y) 
in the XZ-plane. The adjustment of the image phase is carried out by the positioning 

15 unitPE. 

After an amplitude modulation has been impressed on the scan line, 
the radiation passes through an element in which the structure is displaced in a 
wavelength-dependent manner (ST) and the coding phase is accordingly varied in a 
wavelength-dependent manner. A possible arrangement for phase coding was 

20 already described with reference to Fig. 7A. The plane-parallel plate used in this 

case is situated in an intermediate image plane; the periodic structure ST (shown in 
Fig. 7B among others) is preferably arranged directly on the plate. 

Following the phase coding or frequency coding of the amplitude 
modulation, the excitation radiation reaches the specimen via the main beam splitter 

25 (MDB), the Y-scanner, the scan optics (SO), the tube lens (TL) and the objective 

(O). The Y-scanner scans the scan hne to record a phase image in the y-coordinate. 
The fluorescence excitation is carried out with the corresponding wavelengths 
depending on the dyes used. The modulation Frequency and modulation phase of the 
scan line is transferred to the fluorescence signal in this way depending on the 

30 excitation wavelengdi. In descanned detection, the lluorescences are collected by 

the objective and anive at the main beam splitter (MDB) via the tube lens, scan 
optics and Y-scanner. This main beam splitter (MDB) separates the fluorescence 
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from the excitation radiation. Following this, the fluorescence is niiaged on a line 
detector (DE) through a slit diaphragm. Additional blocking fdters nuiy be placed in 
front of" the line detector to suppress the excitation wavelength. The slit diaphragm 
can be dispensed with particularly in niultiphoton excitation. The separation of the 
individual signal components that have been generated by the various wavelengths 
and the calculation ofthe optical sections are carried out based on the algorithm 
described above, for exaiiiple, using the coding phases at the same modulation 
frequency, wherein the coding phases of the individual wavelengths have been 
determined beforehand with lest objects such as plane mirrors. Accordingly, regions 
which have been dyed with different dyes can be made visible separately, 

Another arrangement uses a dispersive element (DG), e.g., a 
transmission grating, which is located in a pupil plane ofthe microscope 
atrangement. The optics diagram in Fig. 11 is shown in the XZ-plane. The 
transmission grating displaces the individual scan lines within the drawmg plane 
con-esponding to their wavelength (only one WL shown). Accordingly, a different 
phase position ofthe modulation structure ST (coding phase) is impressed on the 
individual scan lines corresponding to their wavelength. The displacement ofthe 
image phase is carried out by means ofthe positioning unit (PE) and the modulation 
structure S for every wavelength with identical step size. This ensures that the 
image phase displacement is 120° for every excitation wavelength, for example, 
when three phase images are taken. 

Advantageous arrangements for generating the frequency coding and 
adapting the optical resolution are described more fully in the following. 

The effective pinhole size, i.e., the optical section thickness for the 
individual wavelengths, can be adapted by changing the modulation frequency for 
every excitation wavelength. 

Fig. 7C schematically shows a device for wavelength-dependent 
adjustment ofthe modulation frequencies which is advantageously installed, instead 
ofthe structure ST, in aiTangements 1 and 2 (as shown in Fig. 9, for example) in an 
intermediate image plane ofthe microscope device. In so doing, a polychromatic 
light source is spatially split into its spectral components by a dispersive element 
(DGl). Following this, the spectral components are made axially parallel with a first 
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lens (lens 1, focal length f). i-e., DGI lies in the focal point of the lens. The structure 

(ST) with which the amplitude modulation is carried out is located in the imaging- 

sidc focal plane. A possible construction of the structure with linear dependence of 

the frequency in y-direction is shown schematically in Fig. 7D. 

The splitting into lines LI, L2, L3 which is earned out according to 

Fig. 7C produces different modulation frequencies on this periodic structure through 

the different positions of the lines in y-direction. 

Thus, when a spatial splitting of the polychromatic light source is 

carried out with linear dependence on the wavelength, e.g., by a transmission 
grating, then, with a suitable grating design, the modulation frequencies of the 
individual spectral components also change depending on the wavelength. In this 
way it can be ensured, e.g., that the same optical section thickness is realized at 
different wavelengths. The individual spectral components are subsequently 
spatially superimposed again by means of a second lens (lens 2, focal length f, which 
need not be the same as the focal length of lens 1) and another dispersive element 
(DG2, e.g., transmission grating, which need not be identical to DGI). The beam 
expansion can be controlled or monitored by adapting the focal lengths of lenses I 
and 2 and the illumination of the microscope objective can accordingly be 
optimized. The following advantageous variants of the mvention resuU from a 
structure of the kind mentioned above. 

a) A different change in phase can be generated in a defined 
manner (after prior calibrating measurement) for the individual lines by means of a 
displacement of the stnicture ST m x-direction, wherein, in the different phase 
positions, a complete scanning of the specimen by means of the respective line is 
carried out and wavelength-dependent section images are calculated. The section 
thickness can be changed by means of a defined shift in frequency by displacement 
in y-direction. 

b) By means of (at least one) displacement in y-direction, the 
modulation txequency is changed in a defmed manner and section images can 
accordingly be calculated by repeated scanning at different modulation frequencies 
foi- the individual wavelengths. Further, a frequency coding and/or phase coding can 
be generated for different wavelengths via the different modulation frequencies of 
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the structure with imaging of all wavelengths on a conmion line (see an angement 4). 

Instead of the structure with continuous change in modulation 
frequency in y-direction which is shown in Fig. 7D, a structure (see also Fig. 16) 
which is composed of a plurality of partial structures of drfferent modulation 
frequencies can be used. This has the disadvantage that the structure is adjusted only 
for Fixed excitation wavelengths. However, in the simplest case, different gratings 
ST, each with a different modulation frequency, can also be swiveled into the 
arrangements 1 and 2. 

In another arrangement, not shown, the radiation, after structuring, 
passes an element in which the structure is increased in a wavelength-dependent 
manner, so that the modulation frequency varies in a wavelength-dependent manner, 
i.e., a frequency coding is carried out. In a first arrangement, the scan line is split 
into its individual wavelength components by dichroic beam splitters and a 
wavelength-dependent increase is subsequently impressed in the partial beam paths 
with a telescope having zoom optics for adjusting the increase. The individual scan 
lines are superimposed again by means of additional dichroics. Alternatively, in 
another arrangement, special diffractive elements which generate a wavelength- 
dependent increase in the scan line can also be used. 

At the start, the scan line has a specific coding frequency of 
amplitude modulation depending on the wavelength that is used. The displacement 
in the image phase is carried out by means of the positioning unit (PE) and the 
displaceable structure ST for every wavelength with an identical step size. This 
ensures that the image phase displacement for each excitation wavelength is 120°, 
lor example, when three phase images are taken. Instead of talcing phase images, the 
optical section can be calculated from two images in which the modulation 
frequency is different per excitation line in the two images. The change in 
modulation frequency for all wavelengths or one wavelength can advantageously be 
carried out by taking the two images at dift^rent positions in the y-direction of the 
transmission grating according to Fig. 7D. 

It can be ensured by means of the arrangements described above, for 
example, that the axial optical resolution of the microscope is identical for different 
wavelengths. Accordingly, colocalization measurements are possible with a linear 
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scanner. In addition, the effective pinhole can be increased, ibr example, in case of 
very wenk nuorescence signals, by displacing the structure in y-direction, see Fig. 
7D, in lliis case, downward. While this reduces the optical resolution, the signal-to- 
noise ratio can be improved. 

In addition, the above-described zoom optics, not shown, serve to 
compensate for the chromatic longitudinal error of the imaging optics and, 
accordingly, to ensure that the optical slice is carried out in the same object plane. 
For this purpose, a lens of the individual zoom optics is misaligned slightly 
depending on the microscope objective employed, so that the beam Ibr the 
individual wavelengths at the output of the zoom optics impinges divergently or 
convergently on the objective pupil and the focus can accordingly be shifted in axial 
direction depending on the excitation wavelength, i.e., made to coincide for all 
excitation wavelengths. 

In addition to constructions 1 and 2, another dispersive element (PR) 
can be used for additional spectral splitting of the fluorescence signals vertical to the 
illumination line (multispectral hne scanner). Fig. 12 shows the detection diagram 
of a CCD surface of the multispectral line scanner in the XZ-plane. The structured 
emission signals for the respective wavelengths are imaged in the x-direction of the 
detector (DE). 

The adjustment of the image phase can also be carried out in this case 
by the X-scamier as an alternative to the displacement of the phase position by 
means of PE. 

An image is taken for every scan position of the scan line, as is 
shown for different detection wavelengths. The freely programmable control of 
selected detector elements (lines) and the combination of detector elem ents of a 
column of the detector matrix allows a flexible selection of spectral regions of the 
fluorescence emission. For this purpose, a plurality of lines of the detector in which 
different fluorescence signals are imaged corresponding to their wavelength can be 
connected together electronically. The multispectral detection of the .fluorescence 
emission can be combined again with the structured illumination. For this purpose, 
the line-shaped excitation is structured in addition, e.g., by means of a transmission 
grating (ST). In this connection, a complete scan process of the scan line is carried 
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out by detecting the wavelength distribution corresponding to the imaging in Fig. 12 
and further scanning processes are earned out by changing the image phase of the 
grating stnicture. Since a plane plate PL has been tilted in a defined manner, for 
example, for detenniiiing a wavelength-dependent offset, the change in phase 

5 position can be carried out, e.g., through displacement by PE at a constant tilting 

angle. The depth contrast can be optimized again by sequential detection of images 
of structured objects with different image phases of excitation and subsequent 
calculation. Fig. 12 shows the combination of a multispectrai line scanner (spectral 
splitting is carried out in the y-plane, that is, into the drawing plane) with structured 

10 illumination via tlie structure ST, wherein the phase coding is earned out again by a 

tilted plane-parallel plate (not shown) which is displaced vertical to the optical axis 
or by a dispersive element (see above). The image phase is varied sequentially. The 
different spectral components are detected in parallel by means of CCD arrays. 

The slit diaphragm (SB) which serves in this case as an entrance slit 

15 for the spectral splitting can be omitted in case of descanned detection in the line 

scanner. While this reduces spectral resolution, it considerably simplifies apparatus 
because, otherwise, displaceable individual slit diaphragms would have to be used. 

Fig. 13 shows schematically the construction of the electronics for 
detecting the signals with a line detector. For this purpose, signals of the detector 

20 Kl-N are amplified by means of a current-voltage converter (A) and are 

subsequently integrated (I) during the pixel holding time. AfTter further amplification 
for level matching to an analog-to-digital converter (ADC), these signals are 
converted into digital signals in the ADC and are transfeixed to a computer (PC). 
Detection with a CCD matrix is known from the technical literature. 

25 

Arrangement 3: Structured illuininatiou with quasi-simultaneous recording of 
phase images 

The detection of die stripe images can also be carried out quasi- 
30 simultaneously in that a plurality of lines (e.g., LI, L2, L3), instead of one line, are 

imaged in the specimen in parallel, wherein the intensity structure (image phase) is 
displaced , e.g., by 120°, in a manner analogous to Fig. 4, for example, when using, 



1 ill Ji. ii- ■ ir'n ri! 'i;-:!! . , rii m- p' >^", o 



e.g., three lines (Fig. 14). Accordingly, all of the information for evaluating the data 
is generated already in the one-time scanning of the specimen. Fig. 15 schematically 
shows the optical construction in the YZ-planc. 'fhe focal points along the y-axis of 
the line foci are shown. The excitation light can be split by a beam splitter 
5 arrangement (T). Two embodiment forms of the beam splitter airangement (T), 

which in this case is arranged in front of the cylindrical lens, are shown in Figs. 
1 6A-B. The first anangement, in cooperation with the cylinder lens, generates a 
plurahty of discrete line foci with two min ors arranged in parallel, wherein the first 
mirror is a full mirror and the second mirror is a partially transmitting mirror. The 
10 transmission of the partially transmitting mirror is adapted to every partial beam (i) 

and results from 100%/(n-l), where n is the total number of individual foci. 
Subsequently, the components (i) arrive separately in a special grafing structure (ST) 
which is shown schemafically in Fig. 16A. The partial gratings are modulated in 
this stmcture with a defined phase offset. Instead of the structure composed of 
15 partial gratings, a transmission grating according to Fig. 7B which is rotated as 

shown in Fig. 16A can also be used, so that the phase offset of the structure can be 
adjusted deUberately for the individual scan lines with idenfical modulation 
frequency in each instance. The calibration of the device, i.e., the detenninafion of 
the modulation frequency and the phase positions of the scan lines, is carried out 
20 according to the method described above. The stmcture is located in an intermediate 

image plane of the microscope arrangement. The splitter airangement can also be 
used, for example, in a pupil plane of the microscope arrangement. In this 
connection, both mirrors are tilted toward one another so that a plurality of line foci 
are formed again. 

25 The second arrangement in Fig. 1 6 (Fig. 16B) is a special 

arrangement for generating a double-line focus. The arrangement again uses two 
mirrors (SPl and SP2) arranged in parallel, one of which mirrors (SPl) caixies the 
structure ST itself The structure reflects at the points of low transmission. The 
structure is arranged in the intermediate image of the microscope arrangement. Two 

30 lines whose amplitude modulations are in exactly opposite phase occur at the output 

of the splitter. The line 1 accordingly has an amplitude modulation that is exactly 
shifted by 180° relative to line 2. The structure is applied to glass plate I. When a 
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plurality of wavelengths are used, the wavelength-dependent parallel offset in y- 
direction is compensated through the plane-parallel glass plate by a second glass 
plate of the same thickness which is arranged at an angle of 90°. In addition, the 
entire splitter unit (T) is tilted slightly about the y-axis tbr generating the phase 

5 coding described above. A displacement of the structure (ST) can be dispensed with 

in both ammgements. The scanning movement of the Y-scanner is carried out over 
the image field actually being examined, so that every point on the specimen to be 
examined is illuminated ot\ce by a line of a different phase position of the structure. 
This arrangement is particularly advantageous for examining rapidly changing 
10 specimens because movements or rapid changes in the specimen no longer have an 

interfering effect on the measurement and the maximum image recording speed of 
the line scanner is not reduced by the sequential data acquisition. The detection of 
the lines v/hich are excited in parallel is caiTied out with a matrix detector which, in 
the case of three lines, for example, is a three-line detector. Alternatively, a line 

1 5 detector on which all lines separated on the specimen are detected simultaneously 

can also be used. The separation of the information of every line can be carried out 
by means of the algorithm described above on the basis of different modulations (in 
phase and/or frequency) of every Une. 
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Arrangement 4: Structured illumination with quasi-simultaneous multispectral 
excitation 

In a fourth arrangement, a plurality of discrete excitation wavelengths 
are Ibmied so as to be spatially separated in different scan lines (e.g., with three laser 
lines: LI, L2, L3 in x-direction) in the specimen. For this purpose, a plurality of 
parallel excitation lines of different wavelength are generated (see Fig. 17) by a 
dispersive element (PR) (e.g., transmission grating, grating lines in x-direction) and 
are moved over the specimen by means of the y-galvo-scanner (y) and subsequent 
optical imaging in such a way that every point in the scan field under consideration 
is scanned at least once by every line. The optical construction is shown 
schematically in the YZ-plane in Fig. 18. The beam centroids of the line foci are 
shown in the drawing. 

The splitting of the fluorescence signals by the excitation is again 
carried out with the main color sphtter (MDB). The fluorescence signals which have 
been generated by the different excitation lines arrive on different positions LI -L3 in 
z-direction of a matrix detector with slit diaphragms aiTanged in front of the latter in 
x-direction, wherein the axis at right angles to the illumination line coiresponds to 
the corresponding wavelength of the fluorescence. The axis along the illumination 
line on the matrix detector corresponds to the spatial coordinate. 

In addition, a phase coding or frequency coding can also be carried 
out corresponding to arrangements 1 and 2. For example, for phase coding the 
structure (ST) is tilted about the Y-axis. Frequency coding can be carried out, e.g., 
with the special structure shown in Fig. 7D. When using a phase coding or 
frequency coding, the spectral components can again be detected simultaneously 
with a detector matrix which simultaneously detects all scan lines. In the simplest 
case, a CCD line with rectangular pixels (or joined lines) can be used for this 
purpose, the longer sides of the pixels advantageously being oriented in direction z 
(see Fig. 18), so that, for example, the scan lines LI to L3 are detected jointly by the 
detector line. The separation of the signals which have been excited by the different 
scan line foci is then carried out again according to the algorithm described above. 
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The advantage of these arrangements consists in that the individual scan hnes need 
no longer be detected separately on a detector array, but can be detected by a one- 
dimensional detector. 

In addition, another dispersive element can be used for additional 
spectral splitting of the fluorescence signals at right angles to the illumination line. 
The detection scheme for the multispectral line scanner shown in Fig. 12 can be used 
for this puq^ose. A spatial coordinate is imaged in one direction of the detector. The 
freely programniable control of selected tlctector elements (lines) and the 
combination of detector elements of a column of the detector matrix allows a 
flexible selection of spectral regions of the fluorescence emission. For this purpose, 
a plurality of Imes of the detector in which different fluorescence signals are imaged 
corresponding to their wavelength are joined electronically. The multispectral 
detection of the fluorescence emission can be combined agam with the structured 
illumination. For this purpose, the line-shaped excitation is additionally structured, 
e.g., by means of a transmission grating. The depth contrast can again be optimized 
by sequential detection of images of stmctured objects with different image phases 
and subsequent calculation. Fig. 1 8 shows the combination of a multispectral line 
scanner with sti-uctured illumination. The image phase is varied sequentially with 
various structures. The different spectral components are detected in parallel by 
means of a CCD array, for example. According to the prior art, a plurality of freely 
movable diaphragms arranged conjugate to the individual scan lines had to be used 
in this arrangement as confocal slit diaphragms; however, these can be dispensed 
with due to the structuring of the scan lines. The expenditure on technical apparatus 
is considerably reduced in this way. 

Arrangements: Structured illumination with punctiform specimen interaction 

In a nrih arrangement, a punctiform excitation of the specimen is 
carried out instead of a li ne-shaped excitation of the specimen. For this purpose, the 
laser scanning microscope corresponding to Fig. 1 is operated according to the prior 
art. However, a structure (ST) corresponding to Fig. 19 is used in an intermediate 
image plane which is airanged after the scanners x and y in the direction of the 
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specimen. The structure is imaged successively in the specimen by scanning in the 
x-direction and y-direction. The recording of phase images is carried out by means 
of a displacement of the KStructure with the PE. In addition, a quasi-simultaneous 
ilhmiination can be carried out according to arrangements 3 and 4. A phase coding 
or frequency coding with the arrangements described above is transferable without 
restrictions. The advantage of this arrangement over a conventional point scanner is 
that the signal of the specimen can also be measured without descanning directly 
with a CCD camera. In this case, the confocal diaphragm is also omitted. A gated 
camera (Picostar, La Vision), for exiuiiple, can also be used as a CCD camera. 
Accordingly, for example, time-resolved fluorescence recordings of confocal optical 
sections can be achieved. According to the prior art, this is only possible through 
the use of nonlinear specimen interactions. 

However, a descanned punctiform detection or partially descanned 
detection (Stimson, et al. Rev. of Sc. Instr., (70), p3351, 1999) accordhig to the 
prior art can also be carried out. 

Further, by means of the phase coding or frequency coding, the 
signals of the specimen excited by different wavelengths can be recorded 
simultaneously with the described detection variants. Only one detector is needed 
for this purpose. Accordingly, the construction of a laser scanning microscope can 
be decisively simplified by this arrangement without limiting flexibility. By 
switching on the structure, it is possible to switch back and forth between a 
conventional laser scanning microscope and a laser scanning microscope with 
stnictured illumination. 

A combination of methods 1-5 is likewise .part of the invention. 
Further, a combination of the methods described above with parallel scanning 
methods according to the prior art is also possible without limitation. In these 
methods, a plurality of points or lines of identical intensity are imaged 
simultaneously as a matrix in the specimen (Buisl, et al., .). o. Microscopy (192), 
p2l7, 1998; Nielsen, et al., J. o. Micro.scopy (201), p852, 2000), In this way, image 
recording rates can be fiirther increased. Further, the specimen can be imaged by a 
table scanner or a scanner according to the prior art (e.g., Nipkow disk). 
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The advantageous arrangements described above can also be used 
advantageously for examination of macroscopic specimens. Macroscopic specimens 
are used, for example, in screening active ingredients on a chip. The edge length of 
the scan fields amounts to several times 10 nnii. These scan fields can be achieved, 
e.g., by increasing the scan angle of the galvo-scanner, by arranging the specimen in 
an intermediate image of the microscope anangement, for example, in Fig. 2, or by a 
special objective arrangement (macro-objective) which images the intermediate 
image on the specimen in magnified manner. 

An arrangement for increasing the fluorescence signal in tv/o-photon 
or three-photon excitation by a factor of 1.5 or 2.5 is described in Hell, et al.. Journal 
of Microscopy, Vol. 202, Part 3, June 2001, 457-463. For this purpose, a parallel 
excitation of the specimen is can ied out in a plurality of foci which are illuminated 
three-dimensionally by the multiplex method. The illumuiation patterns generated 
by interference are shifted spatially over a period and the signal is recorded in a 
time-averaged manner over this period. The aim of this arrangement is to increase 
the fluorescence signal in multiphoton excitation. This method has no influence on 
the spatial resolution, i.e., the optical resolution is achieved by the nonlinear 
interaction in the individual specimen points according to the prior art cited above. 

According to the invention, an interferometric superposition of at 
least two partial beams is used in this case for redistributing the average energy over 
the scan field to be examined. The redistribution of the average energy results in an 
increase in the fluorescence signal in multiphoton excitation. In addition, the 
interferometric superposition of the partial beams produces the above-described 
structuring of the scan line for increasing optical resolution. With the same 
fluorescence signal, the average output per specimen point can be reduced, so that 
there is reduced loading of the specimen to be examined. In addition, in comparison 
to the prior art, more specimen points can be examined simultaneously with the 
same output power of the laser, or lasers v/ith lower output power can be used with 
the same quantity of specimen points. 

The method according to the invention is accordingly particularly 
suitable for use in applications requiring a nonlinear specimen interaction, since they 
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can be examined with reduced excitation intensity and, tiierefore, with less damage 
to specimens. 

1 he principle ot the method described herein consists in that a laser 
beam is divided into at least two partial beams of identical power by means of beam 
splitters or by pupil division, wherein the wavefronts of the partial beams enclose a 
small angle of typically less than 5° relative to one another. The n-partial beams are 
subsequently superimposed interferometrically in one of the specimens, so that a 
j)eriodic hinge pattern results depending on the adjusted angle. The intensity 1^, of 
the fringe pattern along the coordinate x (excitation) can generally be described as 
follows: 

/ ) = |z '^p^' ^- 1 

In this case, Iq is the total intensity of the laser on the specimen which 
is split into equal parts on the n partial beams; Q, are the angles and are the phase 
relationships between the partial beams with reference to an arbitrarily selected 
partial beam. 

Different projection scenarios of the structure can be obtained by 
means of a phase shift (by changing the phase relationships ^-^ of the structure 
vertical to the optical axis. The modulation frequency of the structured illumination 
is detennined by the angles Q,. 

Fig. 20A shows two plane wavefronts in the X/Y plane - partial 
beams Tl , T2 of wavelength X which enclose an angle 0 relative to the optical axis 
of the arrangement and interfere with one another. 

A diffraction-limited periodic line-shaped intensity distribution 
results along X on the specimen by means of focusing in Y-direction, for example, 
through a cylindrical lens ZL in the specimen plane. Further, the line-shaped 
intensity distribution along X on the specimen can be carried out by diffractive or 
holographic elements according to the prior art ("Diffractive optics in^prove product 
design", Photonics Spectra, Laurin Publishing Co., Inc., September 1995). Further, 
a Powell lens, as it is called, such as is described in US 4',826,299 can be used. The 
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latter element generates a more homogeneous intensity distribution along the lens 
compared with the cylindrical lens. For this purpose, the Powell lens and the 
diffractive or holographic elements are arranged in a particularly advantageous 
manner, for example, in a pupil plane of the microscope device, between the light 
source and scanner. 

For the general inter ferometric superposition of two partial beams of 
identical intensity (with total intensity Tq), each with a plane wavefront, the 
following intensity modulation is given vertical to the optical axis: 

( = ■'o • [l + cos(A • sin{(9) • x + • ■ • where -■■k^lnlX ( 1 ) 

0 is the angle between the two wavefronts of the two partial beams. \ and % are the 
wavelength of the partial beams and the phase position of the modulation frequency 
p. By changing the angle 0, the period of the modulation can be deliberately 
adjusted and a change in the optical section thickness can be carried out (see below). 
Further, the modulation frequency changes as a function of the wavelength that is 
used and the frequency coding described above can be canied out. The phase of the 
modulation frequency is determined by the phase relationship % between the two 
partial beams. By varying % in accordance with the preceding description, the image 
phases can be adjusted and a phase coding can be carried out. 

The resulting intensity modulation for a linear specimen interaction 
(single-photon interaction) is shown in Fig. 20B (1). The respective intensity is 
plotted along the scan line (x coordinate) in the graph, where Io=l is assumed 
without limiting generality. The modulation is consinusoidal with period p and 
oscillates between 0 and 2 around the axis of symmetry 1. 

The increase in the total signal with nonlinear specimen interaction 
(multiphoton excitation, generation of a higher hamionic) v/ill be described more 
fully in the following with reference to the interferometric supeiposition of two 
partial beams. 

When a nonlinear interaction with the specimen takes place, a 
detector measures the following signal S^, resulting from the interaction: 



(2) 



1 in o ii-ii" o iF'ii «"3i ni qi- p «:■» 



where N is the order of nonlinearity. The corresponding signal resuUing horn 
this equation along the scan line is shown in Fig. 20B (2) for a quadratic specimen 
interaction N=2 (e.g., two-photon excitation), wiiere lo= 1 is assumed without 
limiting generality. The modulation is periodic with period p. But the modulation is 
now asymmetric and oscillates between 0 and 4, since cos-(x) is asynmietnc to 1 . 
This asymmetry increases for greater values of N. 

The signal S^, generated per period of intensity modulation is 
obtained by integrating the signal Sn(x) in x-direction: 

S,^ = \ImU)^^'x, (3) 

Tn comparison, the following specimen interaction results for a 
homogeneous distribution of the light intensity Iq along the scan hne in direction x: 



(4) 



Once again. Fig. 21 shows generally the specimen interaction using a 
structured scan line in comparison to a homogeneous scan line, the intensities being 
identical in both lines. The ratio Sn/Fn is shown as a function of the order of 
nonlinearity N. It will be seen that for N>1 , i.e., for a nonlinear specimen 
interaction, the ratio is greater than 1 . This means that at a constant average 
excitation intensity Iq the efficiency of the specimen interaction increases through 
the use of a modulated line compared to a homogeneous scan line. In the case of a 
two-photon interaction, the efficiency is greater by a factor of 1.5, for example. 

Fig. 22 shows schematically different constructions tor generating 
two partial beams. The object beam paths are shown in each case. A distinction is 
made here between generating the partial beams by dividing the microscope pupil 
(Figs. 22A and 22B.) and by using beam splitters (Fig. 22C). Splitting into two 
partial beams is carried out in a pupil plane of the microscope and in the xz plane of 
the microscope arrangement, i.e., in the plane in which the scan- line is generated. A 
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division of the pupil is particularly useful when a plurality of wavelengths are used 
over a wide spectral range, since the energy distribution on the two partial beams is 
not dependent upon wavelength. However, it is disadvantageous when the beam 
profile of the light source is not homogeneous. In this v/ay, an unhomogeneous 
modulation depth along the scan line can be brought about in the arrangements A 
and B. This is prevented by the airangement in Fig. 22C. However, requirements 
regarding the spectral characteristics of the beam splitter are stricter in this 
arrangement. In general, it is possible to adapt the beam profile, e.g., through the 
use of diffractive elements and a combination with ammgements according to Figs, 
22A, 22B or 22C. 

In Fig. 22A, light froni the light source LQ which generates a 
colliraated light bundle is transmitted through a Fresnel biprism FBP. The 
cylindrical lens ZL is located after FBP and acts in the plane vertical to the drawing 
plane and optical axis. As is shown in Fig. 22D, ZL can also be arranged in front of 
FBP without limitation. The splitting of the collimated beam of the light source into 
two partial beams of identical energy which enclose an angle 0 of typically less than 
5° is carried out by means of the biprism. The two partial beams intersect in an 
inteiTuediate image ZB of the microscope arrangement. The line fomaed by the 
cylindrical optics ZL along the x-direction in the intermediate image is located in the 
xy plane. The drawing shows, by way of example, cylrndrical optics ZL which 
fociis the light of the light source LQ in the intermediate image ZB, i.e., the ZL 
stands at a distance exactly corresponding to the distance of focal length from the 
intermediate image. The partial beams reach the specimen through the following 
optics of the microscope arrangement (see Figs. 9, 10, 1 1, 12 and 23) via the 
scanners X and Y, the scan optics SO, the tube lens TL and the objective O. In the 
specimen, the two partial beams overlap interferometrically and form a periodically 
structured scan line along the x-axis. The period of the scan line is dependent on the 
angle of inclination 0 of the FBP (see Fig. 22 A) and the wavelength of LQ. The 
image phase, i.e., can be deliberately adjusted by a rotation of FBP abotit the 
point of rotation DP in Fig. 22A. For a detailed description of the microscope 
arrangement and the method for generating the phase images and the calculation of 
the section images, reference is had to the preceding description. The advantage of 
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variant A is tliat, by inserting FBP and ZL into the niicroscope beam path, a point- 
scanning laser scanning microscope can be reconfigured in a particularly 
advantageous manner to a microscope which scans in real time and in parallel 
manner, inirther, the modulation frequency is highly dependent on the wavelength 
of the radiated light through the prismatic elTect of FBP. This is advantageous 
especially for frequency coding (see above). However, llie prismatic efttct of FBP 
is problematic when using short pulse lasers with pulse lengths of less than 100 fs, 
since the individual spectral components of the laser pulses are imaged at different 
locations on the specimen and consequently can result in a widening of the pulses 
and therefore in a reduction in the pnlse peak power. Fig. 228 therefore shows 
another advantageous anangement. In this case, the splitting is caiTied out with a 
reflecting element such as a roof mirror DKS. DKS is arranged in the light source 
module (see Figs. 9, 10, 1 1 , 1 2 and 23) in such a way that the partial beams with 
identical energy intersect in ZB in the xz plane at an angle 0. ZL again focuses the 
LQ in the yz plane, so that a line is formed in ZB. By changing the angle between 
the two mirrors Ml and M2, e.g., by means of a piezo-actuator or a spindle pressing 
against M2 or Ml, the angle 6 between the two partial beams and, accordingly, the 
modulation frequency can be adjusted in a deliberate manner. In addition, an 
adjustment of the image phase % can be carried out by a rotation of DKS about the 
axis of rotation DP shown in the drawing. The recording and calculation of the 
optical sections again take place in a manner analogous to the method already 
described above. 

In the arrangement according to Fig. 22C, two partial beams with 
identical energy are generated through the beam splitter BS - a partially transmitting 
plane mirror. This was described, for example, in DE 19904592 Al . However, in 
this case, there is advantageously a cooperation with the element for shaping the 
line-shaped intensity distribution, e.g., by means of cylindrical lens ZL for 
generating a scan line. 

The partial beams subsequently pass via two mirrors M l and M2 in 
direction ZB so that they intersect exactly in ZB in the xz plane. ZL again focuses 
the beam in the yz plane so that a Une is formed along x in ZB. The angle 6 can be 
adjusted by the rotation of BS. The adjustment of the image phase % can be carried 
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out by a displacement of M 1 or M2 or by jointly displacing M l and M2 al a constant 
distance. The recording and calculation oflbe optical sections is again carried out in 
a manner analogous to the preceding description. 

With regard to the complete arrangement of a microscope, 
5 particularly a laser scanning microscope, with the described arrangements for the 

interference of partial light beams, reference is had to the arrangements described 
above (e.g.. Figs. 9, 19, 23) which contain a light module. 

While the foregoing description and drawings represent the present 
invention, it will be obvious to those skilled in the art that various changes may be 
1 0 made therein without departing from the tnie spirit and scope of the present 

invention. 



